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Abstract 

This paper introduces a measure of uncertainty in the determination 
of the Shapley value, illustrates it with examples, and studies some of its 
properties. The introduced measure of uncertainty quantifies random vari- 
ations in a player's marginal contribution during the bargaining process. 
The measure is symmetric with respect to exchangeable substitutions in 
the players, equal to zero for dummy player, and convex in the game ar- 
gument. The measure is illustrated by several examples of abstract games 
and an example from epidemiology. 
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The dread of beatings! Dread of being late! 
And, greatest dread of all, the dread of games! 
Sir John Betjeman, "Summoned by Bells", ch.7 

1 Introduction 

An important problem in epidemiology is to assign weights to the factors that 
contribute to an increase in the incidence rate of a disease. For example, a 
higher incidence rate of a heart disease may be attributable to smoking, bad 
eating habits, or lack of physical exercise, and epidemiologists are interested 
in quantifying the relative degree of importance of these factors. There are 
different methods to perform the attribution, all of which must deal with the 
fact that the contribution of a factor to the incidence rate depends on the 
presence of the other factors. For instance, smoking may hypothetically have a 
relatively small impact on health unless it is accompanied by other factors. This 
difficulty is similar to the problems that arise in cooperative game theory, and 
in a recent paper ILand and Gefellerl have proposed an attribution according to 
the Shapley value, the standard solution concept from game theory. Specifically, 
they have studied the influence of smoking and three types of cholesterol level, 
LDL, HDL, and VLDL, on a certain heart disease, myocardial infarction. When 
all four factors are absent, the incidence rate of the disease is 77 percent lower 
than the incidence rate in the total population. The Shapley attribution for this 
reduction is 21 percent for smoking, and 41, 8, and 8 percent for the cholesterol 
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levels respectively. A natural question arises about the statistical significance of 
these attributions. The present paper proposes a measure of the uncertainty of 
the Shapley value based on the probabilistic interpretation of this game-theoretic 
concept. 

The uncertainty of the Shapley value is going to be useful not only in prac- 
tical applications similar to the epidemiological example above but also in theo- 
retical problems. For example, following a line of research initiated by Shapley 



Aumann (1975) has shown that as the number of participants in a market econ- 



omy grows, the Shapley value of a game associated with this economy converges 
to the competitive equilibrium allocation. This convergence puts the concept 
of the competitive equilibrium on firm game-theoretical grounds, but only if it 
is presumed that the Shapley value reflects the results of the bargaining in the 
economy accurately. If the Shapley value provides the outcome of the bargain- 
ing with only a limited degree of certainty, then the natural question arises: 
What if the uncertainty of the Shapley value increases with the increase in the 
number of participants? Wouldn't it imply that the outcome of bargaining docs 
not necessarily converge to competitive equilibrium? And if the uncertainty 
does decrease, then how does the rate of the decrease depend on the details of 
the market organization? Answering these questions is important for a bet- 
ter understanding of how the competitive equilibrium is achieved in market 
economies. 

From another perspective, the Shapley value is used not only as a device 
to compute a fair allocation of resources among players but also as a tool to 
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evaluate the prospect of playing a game. The bargaining uncertainty would 
provide an additional dimension for evaluating this prospect. Indeed, both 
experimental evidence and personal introspection suggest that participation in 
a bargaining situation implies undergoing the vagaries of the bargaining process, 
an experience that may be a source of pleasure or displeasure depending on the 
personality of the participant. A measure of bargaining uncertainty would serve 
as a useful tool to investigate this aspect of a game. Characterizing a game by 
both its value and uncertainty is similar to characterizing a weapon by its power 
and precision, or a financial stock by its expected return and risk. In all these 
situations the complexity of a real-world object cannot be compressed into just 
one dimension, it needs at least two for proper description. 

So, how should the game uncertainty be measured? To answer this question, 
let us first examine the different frameworks that are used to define the Shapley 
value. 

The shortest way to define the Shapley value is axiomatic. However, this 
approach is not suitable for measuring the Shapley value uncertainty. This is 
because the Shapley value is the unique solution satisfying all the axioms, and 
relaxation of any of them leads to an infinity of new solutions. In contrast, the 
probabilistic interpretation of the Shapley value suits the problem of defining 
uncertainty very well: the Shapley value is defined as the expectation of the 
marginal contribution to a random coalition, and it is straightforward to define 
the uncertainty as the variance of the marginal contribution. This is the way of 
defining uncertainty that the present paper propounds. 
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The probabilistic interpretation of the Shapley value was sketched by Shap- 
ley in his seminal paper f l)1953[l '). Later it was set on firm ground by Gul (1989){ 



Evans (1996) and Hart and Mas-Colell (1996) in their work on non-cooperative 



foundations of the Shapley value, work that was inspired by Rubinstein's paper 
on the bargaining problem ((1982)). Essentially, in all these probabilistic inter- 
pretations, the randomness of the model is the randomness of bargaining order 
and coalition formation. 

To understand how the randomness in the order of bargaining introduces 
uncertainty about the outcome, it is useful to recall Rubinstein's model of the 
bargaining game. In this game two players aim to divide a pie that has unit 
value. The players are impatient and make offers in turn until some of them 
agrees to the other player's offer. The player who makes the first offer is deter- 
mined by chance. Rubinstein has shown that there is a unique subgame-perfect 
equilibrium in this game. The ex-ante expected payoff of the game is one half, 
but the first player has an advantage and gets greater part of the pie. The un- 
certainty here arises because players initially do not know who makes the first 
offer, and a natural measure of uncertainty is the expectation of the squared 
difference between actual and expected payoffs. 

The present paper generalizes this measure and illustrates with examples 
that the uncertainty of the Shapley value is an interesting object that behaves 
differently in different types of games. Some of its properties are parallel to the 
properties of the Shapley value. The linearity property is, however, replaced 
by convexity. It is also conjectured and proved for certain games that the 
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uncertainty of the sum of two games is larger than the sum of the corresponding 
uncertainties. 

The concept of uncertainty of a game outcome is not entirely new. Roth (1988)f 
has pointed out that the Shapley value is insufficient for decision making pur- 
poses unless the players are risk-neutral to a specific kind of uncertainty in the 
strategic interactions, which he calls "strategic risk" . He distinguishes this kind 
of risk from "ordinary risk" that typically arise in lotteries, and he characterizes 
the class of utility functions that may depend on this risk. Roth, however, does 
not attempt to introduce a quantitative measure of strategic risk, and that is 
the main contribution of the present paper. 

The introduced measure provides a yardstick for both measuring the reliabil- 
ity of the Shapley value and quantifying the strategic risk. The main advantage 
of this measure is its simplicity. Future work will perhaps provide alternative 
measures of uncertainty based on more accurate analysis of bargaining random- 
ness. The purpose of this paper is simply to bring attention to the importance 
of measuring this randomness and to suggest a possible solution. 

The rest of the paper is organized as follows. Section 2 provides notation and 
basic definitions. Section 3 lists examples. Section 4 shows certain properties 
of the uncertainty concept, and Section 5 concludes. 

1 See also Roth (1977a) and Roth (1977b) 
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2 Notation and Definitions 

Let A be a set of players: A = {1, 2, ...N} . A game G is a map from a set of 
all subsets of A to real numbers: 2 A — > M . The interpretation of G(5) is the 
payoff that the coalition of players in subset S can achieve on their own. 

Let (X,fl,fi) be a probability space and /j : X — ► 2 A_ W be a random 
variable that takes its values in the set of all subsets of A — {i}, and has the 
following distribution function: 

Random variable /j can be interpreted as the random choice of coalition that 
player i joins. The particular choice of its probability distribution is motivated 
by both the axiomatic approach and non-cooperative bargaining games that 
support the Shapley value. 

Define the marginal contribution of player i as a function diG that acts on 
coalitions from A — {i} in the following way: 

diG(S) = G(S + i)-G(S). (2.2) 

Then the Shapley value of game G for player i is the expectation of his marginal 
contribution when the coalition is chosen randomly. 

Vi(G) =E{diGofi}. (2.3) 

The Shapley uncertainty of game G for player i is defined as the variance of his 
marginal contribution: 

R i (G)=Var{d i Gof i } (2.4) 
7 



This definition easily generalizes to other, non-Shapley, values. Indeed, al- 
most all reasonable values are probabilistic values I Weber (1988) I, which can 



be represented as the expectation of the player's marginal contribution with 
respect to a certain probability distribution imposed on coalitions. Of course, 
for different bargaining mechanisms the probability distributions may be differ- 
ent. For example, another popular value, the Banzhaf value, corresponds to the 
following probability distribution: 

»{fi(X) = S} = ^ I . (2.5) 

For probabilistic values, it is natural to define the corresponding uncertainty 
as the variance of the marginal contribution. Most of the properties that will 
be derived below for the uncertainty of the Shapley value will also hold for the 
uncertainty of other probabilistic values. This paper, however, sticks with the 
Shapley value as the most popular in practical applications. 



3 Interpretation and Examples 

In many non-cooperative interpretations of the Shapley value, the actual payoff 
of a player is a weighted average of his marginal contribution to a random 
coalition and his expected payoff: 

%i = a{diG(S)) + {l-a)Vi(G). (3.1) 

For instance, in the Rubinstein-Gul-type bargaining models the parameter a is 
related to player impatience. Then, the variance of player payoff is proportional 
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to the Shapley uncertainty: 



Var{7rJ = a 2 i? 2 (G). 



(3.2) 



According to the Chebyshev inequality, it follows that 



Pr 




Vi(G) 



- 1 ^ c } < a 



2 Rj{G) 
! [Vi{G)\ 



2 ' 



(3.3) 



that is, that the Shapley uncertainty provides a bound on the deviation of 
the actual payoff from its expected value. Moreover, if the marginal contribu- 
tions are distributed approximately normally, which is likely to happen in large 
games, then the statistical results for normal distributions are applicable and 
the following inequality holds: 



So, the Shapley uncertainty can be interpreted as measuring the variability of 
the actual payoff. 

Let me now present several examples. 

Example 3.1 Additive game 

In the additive game the value of a coalition is simply the sum of the values of 
individual players. The Shapley value for a player coincides with his individual 
value and, consequently, the risk is zero: Each player can guarantee his own 
value. 

Example 3.2 Uncertainty may be different for different players. 




(3.4) 
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Let a three-player game be defined as follows. G({1}) = 0, G({2}) = 3, 
G({3}) = 6, G({1,2}) - 24, G({2,3}) = 18, G({1,3}) = 21, G({1,2,3}) = 60. 
Then, 

Vi = V 2 = V 3 = 20, 

and 

Ri = 299; R 2 = 230; R 3 = 155. 

This example illustrates that players can have the same Shapley values but 
different Shapley uncertainties. 

Example 3.3 Majority game 

In the majority game the value of a coalition is N if the size of the coalition 
is greater than half of the number of players, and otherwise. For simplicity, 
let the number of players N be odd. Then the Shapley value of the game for 
player i is 

Vi(G) = 1, (3.5) 

and the Shapley uncertainty is 

Ri(G) = N. (3.6) 

So the uncertainty of the majority game increases with an increase in the number 
of players. Intuitively this is because the marginal contribution of a player is 
non-zero only if his vote is pivotal in a random ordering of players, and in the 
majority game with a large number of players this situation is very rare. 
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Example 3.4 Large production economy 2 

An economy consists of N agents, of which kN are capitalists and (1 — k)N 
are workers. Each capitalist owns a factory and each worker owns one unit of 
labor power. K capitalists and L workers can produce V KL units of output. 
What is the value and the uncertainty of the game for the participants? 

It is easy to check that for a random large coalition of size X, the frequency 
of capitalists is distributed according to the Gaussian law: 

k~tf(k,±\ (3.7) 

where k is the sample frequency of capitalists, and AT (E, V) is the notation for 
the Gaussian distribution with expectation E and variance V . The marginal 
contribution of a worker added to this coalition is 



d w G(S)= 1 -^ k (3.8) 

For a large X we can compute expectation and variance of this expression, 
and averaging them over the coalition size, X, gives the value and the uncer- 
tainty of the game for a worker: 



V W (G) = y^- k , (3.9) 
^ (G) ~ i6(l^fcF ^ (whereiV " 0o) - (3 - 10) 



2 This example is based on an example of a production economy in 
|Shapley and Shubik (1967)| and |Osborne and Rubinstein (1994)| 
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Similarly, for a capitalist we have 



Vc(G) 



2 



1 




(3.11) 



Rc(G) 



1 IniV 



(where N — > oo). 



(3.12) 



16A: 3 AT 



In this simple example of production economy, the uncertainty of the game 
decreases as the size of the game grows. The intuition behind this is simple: As 
the number of participants grows, almost all coalitions have approximately the 
same structure as the total population. For these typical coalitions an agent 
has approximately the same marginal contribution, so his uncertainty is low. 

Example 3.5 Large Market Economy 

Suppose there are just two commodities in the economy, apples and bread. 
Assume there are kN apple traders and (1 — k)N bread traders. Suppose also 
that initially each trader has one unit of commodity of his own type, and that 
the utility function of every trader is the same: 



where a is the number of apples and b is the quantity of bread. Assume that 
the utility is transferable. 

Then a coalition of A apple and B bread traders has worth 



and the problem is completely analogous to the problem of Example 13 .41 Thus, 



u(a, b) — Vafo, 



(3.13) 




(3.14) 
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for the apple trader the value and the uncertainty are 



V a {G) = ^/hF' (3-15) 
Ra{G) ~ 16fc3 ln / (where iV^oo). (3.16) 

The expressions for the value and uncertainty of the bread trader are similar. 
Therefore, this example suggests that in the market economy, as well as in the 
production economy, the uncertainty goes to zero when the size of the economy 
increases. 

Example 3.6 Risk Factor Attribution 



The Shapley values for the epidemiological example from Land and Gefeller (1997) 
are 0.405, 0.08, 0074 respectively for abnormal LDL, VLDL, and HDL choles- 
terol levels and 0.211 for smoking. The square roots of the corresponding Shap- 
ley uncertainties can be computed as 0.118, 0.056, 0.057, 0.11. The standard 
statistical test of significance shows that only the effects of abnormal LDL and 
smoking are significant at a 5 percent significance level. 



4 Properties of the Shapley Uncertainty 

Several of the properties of the Shapley uncertainty are similar to the properties 
of the Shapley value and follow directly from the definition. They are scaling, 
"zero risk for dummy" , and symmetry properties: 

Proposition 4.1 (Scaling) Ri(tG) — t 2 Ri(G) 
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Proposition 4.2 (Dummy) If G(X + i) = G(X) + G(i) for any X that does 
not contain i then Ri(G) = 0. 

Proposition 4.3 (Symmetry) If G(X) = G(X — i + j) for any X that con- 
tains i, then Ri(G) = Rj(G). 

For two-player games a stronger symmetry property holds. It states that 
in two-player games both players are always equally exposed to the Shapley 
uncertainty even if their values are different. 

Proposition 4.4 (Strong Symmetry) For any 2- player game Ri(G) — Rj{G). 

For games with more than two players this property is not true but still the 
risks of different players cannot be too different, as the following proposition 
shows. 

Proposition 4.5 For every N -player game G 



Proof: First, the Shapley uncertainty can be defined in an equivalent way. 
Let 03 be the space of all orderings of elements in A. Define a map pi : 03 -^>2 A 
that takes an ordering to the subset of elements of A that precedes element i in 
the ordering, and let diG = diG o p^.Take a random variable g : X — > 03 that 
has a uniform distribution on orderings. Then it is easy to check that: 



Ri{G)<{N-l)Y,Rj{G). 



fi 



Pi°9, 



(4-1) 



Vi(G) 



E(d t Gog) 



Ri{G) 



Var(^Go 5 ). 
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Second, for any ordering b £ the sum of marginal contributions of all players 
is equal to the value of the game, which is not random: 

Y J d~G(b) = G(A). (4.2) 

i 

It follows 

VarOiGog) = Var(^2d~G o g) < (N - 1) ^ Var(d^G o 5 ), (4.3) 

where the last inequality is a well-known inequality for the variance of the sum 
of random variables. So, 

Ri(G)<(N-l)Y,Rj(G)- ( 4 - 4 ) 

QED 

This result suggests that the uncertainty of a game has a component that 
is independent of the strategic situation of an individual. In large games the 
results of similar type imply that even if a player does not know his exact role in 
a game, he is able to evaluate the probable range of the risk that he is going to 
encounter. Therefore, the player could meaningfully compare games on the basis 
of their uncertainty, or riskiness. A possible measure of expected uncertainty of 
a game is the average of the players' uncertainties: 

*(G) = -^f>(G). (4.5) 

i=i 

It is the uncertainty that a player can expect to encounter if he is not yet aware 
of his role in the game. 

The properties above have been mostly concerned with comparison of the 
Shapley uncertainties for the different players. Another important property, 
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convexity, is concerned with behavior of the uncertainty relative to the addition 
of games. 

Proposition 4.6 (Convexity) For each pair of games G and H, 

Ri{aG + (1 - a)H) < aR t (G) + (1 - a)R t {H). 
The equality is only possible if the games are proportionate to each other. 

Proof: The uncertainty of a game is the variance of a random variable. 
The assertion of the proposition follows from the well-known property of the 
variance of a weighted sum of two random variables. QED 

From this property the following upper bound on the Shapley uncertainty 
of the sum of two games follows. 

Corollary 4.1 For each pair of games G and H , 

Ri(G + H) <2[R i (G)+R i (H)}. 

The equality is only possible if the games are proportionate to each other. 

Corollary 14.11 gives an upper bound to the uncertainty of the sum of two 
games. What can be said about the lower bound? The question boils down to 
whether two games with large Shapley uncertainty can add up to a game with 
low uncertainty. Numerical experiments suggest the following conjecture: 

Conjecture 4.1 There exist such d(n) > that for each pair of superadditive 
n-player games G and H 

Ri(G + H)> d{n)(Ri(G) + Ri(H)). 
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This conjecture is true for symmetric convex games. In these games, the 
worth of a coalition depends only on its size and the dependence is non-decreasing 
and convex: 

G(S) = g(\S\), where g'(x) > 0, and g"(x) > (4.6) 
For these games, the following proposition holds 

Proposition 4.7 For each pair of symmetric convex games G and H , 

Ri(G + H) > R i (G)+R i (H). 

Proof: Clearly the proposition holds if player i's marginal contributions 
have positive covariance for each pair of symmetric convex games G and H : 

Cov{d l G{S),d l H{S)}>0, (4.7) 

where S is the random coalition. In other words, it is sufficient to prove that 

E{d l G(S)d i H{S)} - E{d l G(S)}E{d l H{S)} > 0. (4.8) 

Marginal contributions diG(S) and diH(S) are non-negative and non-decreasing 
in argument S, and therefore inequality l|4.8() holds because of the following 
lemma: 

Lemma 4.1 If fi(x) and f2(x) are two non-negative, non- decreasing functions, 
and T(x) is the cumulative distribution function of a random variable, then 



h{x)f 2 {x)dT{x) > / h{x)dT{x) / f 2 {x)dT{x) . (4.9) 
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Proof of Lemma: Note that if the lemma holds for {/{, / 2 } and {/", f%}, 
then it also holds for {a'f[ + cn"/",/ 2 }, where a' and a" are non-negative 
coefficients. Similarly, if the lemma holds for {/i, / 2 } and {/i, / 2 }, then it also 
holds for {/i,/3'/ 2 + 0' f<£}, where and /?" are non-negative. It follows that 
the lemma needs only to be proved for a set of elementary functions that can 
approximate all non-negative, non-decreasing functions by linear combinations 
with non-negative coefficients. It is enough to take the set of the following 
elementary functions 4> T : 

f 

1 if x > T, 



4> T {x) 



(4.10) 
if x < T, 



which are characteristic functions of sets [T; oo). 
Define measure [ijr as follows: 

/oo 
Xx (x)dT(x), (4.11) 
-oo 

where Xx ( x ) denotes the characteristic function of set X. 

In terms of this measure, the inequality for elementary functions becomes: 

^{[T 1 ,oo)n[T 2 ,oo)}>^{[T 1 ,oo)}^{[T 2 ,oo)} ) (4.12) 

which is evidently true because [T l7 oo) n [T 2 ,oo) is either [Ti,oo) or [T 2 ,oo), 
and Hf{X} < 1 for any X. QED. 



5 Conclusion 

In the course of this paper, the concept of the Shapley uncertainty has been 
rigorously defined and illustrated by means of several examples. Certain prop- 
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erties of this concept have been proved that show how the uncertainty changes 
under scaling in the size of the game, substitution in the role of players, and 
taking an average of games. These examples and propositions illustrate that 
the Shapley uncertainty is an object, that has many interesting properties. The 
main question is, however: What is this concept good for? 

Actually, it is good for several important things. First, it measures the re- 
liability of Shapley value solutions to various practical problems. Second, it 
is useful in checking the robustness of theoretical arguments that employ the 
Shapley value as the embodiment of the outcome in market games. Third, the 
Shapley uncertainty is an additional dimension that a player should take into 
account if he evaluates the prospect of playing a game. Finally, the Shapley 
uncertainty may be helpful in the design of games as implementation mecha- 
nisms, where the designer is interested in ensuring the stability of the outcome 
and making the mechanism attractive to risk-sensitive participants. 
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